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Claims 12* 

1. A computer system, characterized by the fact that in a computer system equipped with 
a speech recognition interface that has a GUI environment, obtains a keyword by the speech 
recognition of an operation instruction through speech, and converts the keyword into a control 
command of a system software by decoding the keyword, the above-mentioned system software 
is equipped with a window switching means that switches the window corresponding to said 
control command to a window in an active state when the control conmiand in which specific 
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decoded speech [i.e., words] are received from the above-mentioned speech recognition 
interface. 

2. The computer system of Claim 1, characterized by the fact that the above-mentioned 
system software is equipped with a means that manages the window information of several 
applications, switches said window information to the newest active window of said application 
when each application is designated by the control conmiand from the above-mentioned speech 
recognition interface, and switches it in order of newer windows of said applications by speaking 
the same application name. 

3. The computer system of Claim 1, characterized by the fact that the above-mentioned 
system software is equipped with a means that displays the window activated by the control 
command from the speech recognition interface differently from other windows and displays a 
task list of each window. 

4. The computer system of Claim 1 or 3, characterized by being equipped with a task 
switching means that sets the speech recognition interface to an input device in one of several 
applications by the control conmiand from the above-mentioned speech recognition interface and 
sets a device other than said speech recognition interface to an input device in another 
application. 

5. The computer system of Claim 1 or 2, characterized by the fact that the above- 
mentioned speech recognition interface is equipped with a means that prepares words for each 
application and a conmion word in a word dictionary for speech recognition and gives the above- 
mentioned system software a control command for displaying a keyword list registered in the 
above-mentioned word dictionary or the current effective keyword list on a screen when a 
specific keyword is given. 

6. The computer system of any of Claims 1-5, characterized by the fact that the above- 
mentioned speech recognition interface has a table for converting the above-mentioned keyword 
into a control command; and the table makes several keywords correspond to one control 
command and constitutes table data for obtaining the control command by the reference to any of 
the keywords. 

7. The computer system of any of Claims 1-5, characterized by the fact that the above- 
mentioned speech recognition interface is equipped with a means that displays keyword 
candidates being obtained by compensating the part after a prolonged sound from a speech input, 
in which the suffix of the known part of a keyword is extended, as a list. 

8. The computer system of any of Claims 1-5, characterized by the fact that the above- 
mentioned speech recognition interface is equipped with a means that repeatedly generates the 
control command corresponding to a keyword in accordance with the length of a prolonged 



sound when speech accompanied with said prolonged sound in which the suffix of said keyword 
is extended or speech in which the prolonged sound is added to the keyword is recognized. 

9. The computer system of any of Claims 1-8, characterized by the fact that the above- 
mentioned speech recognition interface is equipped with a speech operation button that 
implements speech recognition only when a user inputs speech, an input level check section that 
implements the speech recognition only when an actual input speech is at a level suitable for 
recognition or higher, and a recognition result reliability check section that checks the reliability 
of the speech recognition result and only accepts the accurately recognized speech. 

10. The computer system of Claim 1 or 3, characterized by the fact that the above- 
mentioned system software is equipped with a means that adopts the window of the position 
being designated by a pointing device as a highly noticeable window by a user and raises the 
frame rate of said window. 

Detailed explanation of the invention 
[0001] 

Technical field of the invention 

The present invention pertains to a computer system equipped with a man-machine 
interface that has a GUI environment and receives a data input or operation instruction through 
speech. 

[0002] 
Prior art 

A man-machine interface for interacting with a computer system where a user inputs or 
instructs data from the user to the computer system by an input device such as keyboard or 
pointing device (mouse, etc.) and displays or rephes various kinds of data from the computer 
system to the user by an output device such as display. 

[0003] 

In addition to the man-machine interface device, input and output devices using speech 
have recently been developed. In a computer system, a speech synthesizer and a speech generator 
are installed as speech output devices, and speech recognizer and decoder are installed as speech 
input devices. 



[0004] 

Problems to be solved by the invention 

In case data are input or instructed to the computer system through speech, a user speaks 
a predetermined keyword (phase or word), and the computer system recognizes the speech and 
decodes it. 

[0005] 

Here, in case the computer system has a graphical user interface (GUI) environment such 
as X-Window system or MS-Windows, several applications (windows) can be processed on the 
same screen, however in actuality, only one application (window) is active. 

[0006] 

In such a computer system, in case the user operates a certain application through speech, 
said application (window) may be in an active state, however if another application (window) is 
active, the active application [currently] being used by the user can no longer be used. 

[0007] 

In this case, in the prior art, the window to be operated was activated by a pointing device 
such as mouse, and a verbal operation instruction was given. Since the operation of the mouse, 
etc., was interposed, the operation efficiency deteriorates. 

[0008] 

Also, if the application to be opened is misunderstood, an irrelevant application is likely 
to be erroneously opened. 

[0009] 

Also, in the computer system having the GUI environment, a number of windows are 
opened and active, however since a number of windows overlap each other, sometimes, the user 
cannot understand active window, the kind of registered application, the task list of the 
applications, keyword list structure, etc. In this case, the upper window is also moved and erased 
by mouse, etc., and while moving the lower window to the upper area, and the active window is 
sought, which is complicated. 

[0010] 

Also, in the instruction of various kinds of operations such as application switching, 
control contents switching, or screen operation, the keywords corresponding to them are spoken. 
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and speech recognition and decoding are required. However, in case the keywords are forgotten 
or only partially forgotten, the operation cannot be initiated by speech. 

[0011] 

The purpose of the present invention is to provide a computer system that is equipped 
with a man-machine interface, which has a GUI environment and instructs the input and 
operation of data using speech, and also increases the operation efficiency by a reliable and easy 
speech-activated selection and operation of a window and an application. 

[0012] 

Another purpose of the present invention is to provide a computer system that easily 
determine a correct keyword, even in case the keyword being stored by a user is ambiguous or 
forgotten. 

[0013] 

Means to solve the problems 

In order to achieve the above-mentioned purposes, the present invention is characterized 
by the fact that in a computer system equipped with a speech recognition interface that has a GUI 
environment, obtains a keyword by the speech recognition of an operation instruction through 
speech, and converts the keyword into a control command for the system software by decoding 
the keyword, the above-mentioned system software is equipped with a window switching means 
that switches the window corresponding to said control command to an active window when the 
control command in which specific speech is decoded is received from the above-mentioned 
speech recognition interface. 

[0014] 

According to this constitution, since a window is switched by a specific keyword by 
speech-activation, a window switching operation using a mouse, etc., is not required. The 
window switching includes a method that sequentially activates windows in a priority order, a 
method that uses different words/phrases in the switching start and end of the windows, starts an 
automatic switching control at each fixed time through the switching start word/phrase by the 
system, and stops the switching through the switching end word/phrase, and a method that 
combines both. Also, a window switching method that gives a "marker" with a priority order to 
each window and activates an optional window by designating the "marker" through speech is 
included. Furthermore, a window switching method that manages the window information of 
several applications, switches a window to the newest active window when each application is 
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designated by speech, and switches it in a new window sequence of said applications by the 
same speech is also included. 

[0015] 

Also, this system is characterized by the fact that the above-mentioned system software is 
equipped with a means that displays the window activated by the control command from the 
speech recognition interface differently from other windows and displays a task list of each 
window. 

[0016] 

According to this constitution, an active window is discriminated from other windows 
and displayed, and a task list in which an active application is discriminated is displayed, so that 
a user easily recognizes the active window and application. 

[0017] 

Also, this system is characterized by being equipped with a task switching means that 
sets the speech recognition interface to an input device in one of several applications by the 
control command from the above-mentioned speech recognition interface and sets a device other 
than said speech recognition interface to an input device in another application. 

[0018] 

According to this constitution, using the task switching, an input into an application 
through speech and an input into other applications through other input devices such as mouse 
are set, so that several windows can be operated [simultaneously]. 

[0019] 

Also, this system is characterized by the fact that the above-mentioned speech 
recognition interface is equipped with a means that prepares words for each application and a 
conmion word in a word dictionary for speech recognition and gives the above-mentioned 
system software a control conraiand for displaying a keyword list registered in the above- 
mentioned word dictionary or the current effective keyword list on a screen when a specific 
keyword is given. 
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[0020] 

According to this constitution, when a user speaks a specific keyword such as keyword 
list, a keyword list registered in a word dictionary or the current effective keyword list is 
displayed on the screen, and a keyword required for a user can be detected from the keyword /4 
list being displayed on the screen. The keyword screen display includes a display by 
applications, a display of a hierarchical structure, and a keyword input through speech by 
including the abbreviation of a keyword, and a keyword display using a macro function. 

[0021] 

Also, this system is characterized by the fact that the above-mentioned speech 
recognition interface has a table for converting the above-mentioned keyword into a control 
command; and the table makes several keywords correspond to one control command and 
constitutes table data for obtaining the control conmiand by the reference of any of the keywords. 

[0022] 

According to this constitution, even if a user does not accurately remember a keyword, 
when a keyword close or related to it is spoken, the intended control command of the user can be 
obtained by the speech recognition and the control command-keyword conversion. 

[0023] 

Also, this system is characterized by the fact that the above-mentioned speech 
recognition interface is equipped with a means that displays keyword candidates being obtained 
by compensating the part after a prolonged sound from a speech input, in which the suffix of the 
known part of a keyword is extended, as a list. 

[0024] 

According to this constitution, a user extends the suffix of the known part of a keyword, 
so that keyword candidates are displayed on the screen. A correct keyword is determined from 
the screen display, and an operation can be initiated by using the correct keyword. 

[0025] 

Also, this system is characterized by the fact that the above-mentioned speech 
recognition interface is equipped with a means that repeatedly generates the control command 
corresponding to a keyword in accordance with the length of a prolonged sound when the speech 
accompanying said prolonged sound in which the suffix of said keyword is extended or a speech 
in which the prolonged sound is added to the keyword is recognized. 
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[0026] 

According to this constitution, instead of repeatedly speaking the same continuous 
control command, one keyword accompanied with a prolonged sound is spoken, so that one 
keyword is spoken to repeat the same control. 

[0027] 

Also, this system is characterized by the fact that the above-mentioned speech 
recognition interface is equipped with a speech operation button that implements speech 
recognition only when a user inputs speech, an input level check section that implements the 
speech recognition only when actual input speech is at a level suitable for recognition or higher, 
and a recognition result reliability check section that checks the reliability of the speech 
recognition result and only accepts the accurately recognized speech. 

[0028] 

According to this constitution, a wrong recognition due to a noise penetration or 
insufficient level speech is prevented, and the reliability of the recognition result is also checked, 
so that a wrong recognition is prevented. 

[0029] 

Also, this system is characterized by the fact that the above-mentioned system software is 
equipped with a means that adopts the window being designated by a pointing device as a 
window with a high degree of notice for a user and raises the frame rate of said window. 

[0030] 

According to this constitution, a window with a high degree of user interest can be easily 
designated without operating an active window. 

[0031] 

Embodiments of the invention 
(First embodiment) 

Figure 1 is a block diagram showing a speech recognition interface section of an 
embodiment of the present invention. A microphone 1 is a speech input means for giving an 
operating instruction to the computer system by a user. 
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[0032] 

A speech recognition interface part 2 has speech recognition part 3, word dictionary 4 for 
a speech recognition, keyword control command conversion part 5, and keyword-control 
command table 6. 

[0033] 

The speech recognition part 3 collates an audio signal from the microphone 1 with the 
word dictionary 4 for a speech recognition, and the keyword with a matched recognition is 
output as a result. For example, in the case a user speaks "open," a character string of "open" is 
obtained as a keyword. 

[0034] 

The word dictionary 4 for a speech recognition, as shown in the figure, prepares words 
for each application and a common word for each application being implemented on the system 
software, and among them, the words and the conrmion word for the application in a currently 
active state are effective. 

[0035] 

The keyword control command conversion part 5 obtains the corresponding control 
command, referring to keyword-control command table 6, using the keyword from the speech 
recognition part 3. 

[0036] 

In the table 6, control commands which are one-to-one correspondent to each keyword 
are described, and the control conrmiand corresponding to the keyword "open" are substituted by 
the operation of keyboard, mouse, etc., and described. 

[0037] 

A system software 8 of a computer 7 is constituted by a software having a GUI 
environment such as MS -Window and X- Window system and has a function of responding to the 
control command from the keyword control command conversion part 5 in addition to a function 
of responding to the operation instruction from the keyboard, etc. 
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[0038] 

A display 9 has a graphic display function corresponding to the display control from the 
system software 8, and a display screen 9A has a display control function for displaying several 
applications (windows) on the same screen. 

[0039] 

Here, in this embodiment, virtual window priority orders are given to all the windows 
being displayed on the display screen 9A in the display control means of the system software 8, 
and the currently active window has the highest priority order. 

[0040] 

Also, the window positioning behind the active window has the second priority order, 
and the window behind it is the third window. In this manner, the priority order corresponding to 
the window position is set. 

[0041] 

Then, the system software 8 has a window switching function that sets a certain specific 
keyword (for example, "window") and switches the window positioning behind the currently 
active application (window), that is, the window with the second window priority order, to an 
active window. 

[0042] 

During window switching by the window switching function, the window which had 
been active previously has the lowest window priority order. 

[0043] 

Therefore, according to this embodiment, when an intended application is in an inactive 
state, a user speaks the window switching keyword, so that the speech is recognized by the 
speech recognition part 3 and converted into the control command by the keyword control 
command conversion part 5. Thereby, the window on the screen 9A is switched by the system 
software 8, and in this switching, each time the window switching keyword is spoken, the 
window is switched to a higher priority order. As a result, a desired window can be in an active 
state. 
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[0044] 

Thus, the user may set the window to be operated to an active state simply by speaking a 
specific keyword without operating a pointing device such as mouse, and an operation can be 
instructed to the window in an active state through speech, so that the operation efficiency can be 
raised and an incorrect operation can be prevented. 

[0045] 

Also, data may be input by either a method using keyboard, etc., or a method that 
recognizes and decodes the data by the speech recognition interface section 2. 

[0046] 

Also, in switching of windows, each time a specific keyword (control command) is 
received, windows have been switched in order of a high priority, however the window 
switching method can be appropriately changed through the system software. 

[0047] 

For example, when a window switching start keyword is received, an active window is 
automatically switched at a certain time interval (for example, each 1 sec), and when a window 
switching stop keyword is received, the window switching is stopped. Furthermore, a combined 
method including the method of this embodiment can be adopted. Furthermore, a method that 
initiates a window switching command and a window number through speech and sets the 
window with said window number to an active window by the system may also be adopted. 

[0048] 

Also, "markers" with priority orders are given to each window being displayed on a 
graphic display, and the "marker" is designated by a word/phrase, so that an optional window 
can be activated. 

[0049] 

For example, in the setup or cancellation of "marker," a user generates a certain specific 
keyword, for example, "setup of marker 1" or "cancellation of marker 1," so that "marker 1" is 
set up or canceled on the currently active window. Then, the window to be activated is 
designated by speaking "marker 1," etc. 
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[0050] 

In this case, the "marker" being set up and canceled is displayed as an icon, and it is 
preferable to detect the "marker" being set up and canceled at a glance. Also, the "marker" is 
used through speech, however its setup or cancellation can be done by other input means such as 
a keyboard. 

[0051] 

In the window switching by the above "marker," compared with the switching by the 
keyword of editor, etc., a desired window can be activated by a word/phrase through switching 
by the "marker" at a window unit, 

[0052] 

Also, a window management section is installed in the system software 8, the window 
information consisting of a window name being displayed, an active window name, and an active 
window history is managed by the management section, and the window can also be switched to 
the newest active window of each application. 

[0053] 

For example, in a state in which several applications A-D are started and non-priority 
windows Al and A2 in each application are displayed, if "application B" is spoken, the 
management section searches for the newest active window of the application B and activates the 
application Bl, for instance. 

[0054] 

Furthermore, if "application B" is continuously spoken, the next application B2 is 
activated. 

[0055] 

(Second embodiment) 

In the above-mentioned embodiment, a window is switched through speech, and the 
corresponding application is operated. However, in case a number of windows overlap each 
other, a user hesitates in deciding if the application is in an active state. Also, the user sometimes 
cannot detect the existence of non-priority windows. 



[0056] 

Accordingly, in this embodiment, as shown in Figure 2, while several applications are 
started, for example, when "task list" is spoken, the system software 8 displays the application 
list being currently in operation (each window name) as a task list from the control command 
corresponding to the keyword as shown in Figure 3. 

[0057] 

At that time, a knitted shape is displayed or special color and frame are displayed so that 
the currently active application (for example, application A) may be easily understood. Also, in 
case a non-priority window exists in each window, for example, in an application D, its non- 
priority window is also simultaneously displayed by a hierarchical structure. Also, the active 
window can be switched in a task list display state. 

[0058] 

According to this embodiment, a user is not required to remember the currently active 
window, and in conforming the active window, several window names can be decided at a look 
and can be easily recognized by the speech of a specific keyword such as "task list." 

[0059] 

(Third embodiment) 

Figure 4 shows another embodiment of the present invention. The difference between 
said figure and Figure 1 is that a task switching part 10 is provided. 

[0060] 

A task conversion part 10 switches and controls an input device for the system software 

8. 

[0061] 

In a normal case, one window (for example, application A) is operated, however in this 
state, if "task switching B" is given to the interface 2 by a speech, the control command is given 
to the task switching part 10. 

[0062] 

At that time, the task switching part 10 switches the input device so that the application B 
may be input through speech and the application A can be input only from the keyword or 
mouse. 
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[0063] 

In order to help the user understand the switching state of the input device, the 
appHcations A and B of the window display screen are different from the other applications, and 
even the application examples are differently displayed, for example, by different colors. 

[0064] 

The return from the above-mentioned input device switching state is carried out with a 
return conmiand to the task switching part 10 through the interface 2 by giving the "task 
switching B" using speech. 

[0065] 

According to this embodiment, several windows can be [simultaneously] operated. 

[0066] 

(Fourth embodiment) 

Figure 5 shows another embodiment. In this embodiment, when a specific keyword is 
given to the keyword control conmiand conversion part 5, the keyword list registered in the word 
dictionary can be displayed and controlled as a list. 

[0067] 

For example, in the constitution of Figure 5, when a user speaks a speech of "keyword 
list" through the microphone 1, the speech recognition part 3 gives the speech recognition result 
to the keyword control conmiand conversion part 5. Said conversion part 5 reads out the 
keyword group registered in the word dictionary 4, uses it as a keyword list data, gives the 
control conmiand of the keyword list to the system software 8, and displays the keyword list on 
the screen 9A by the display control of the system software 8. 

[0068] 

Figure 6 shows a screen display example of the keyword list, and the keywords of all 
applications and a conunon word list are displayed. Also, a knitted shape is displayed so that the 
currently effective keyword may be understood. 

[0069] 

Also, in the case of each application, for example, a word list is displayed with a 
hierarchical structure for each individual application as shown in application A. 
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[0070] 

Also, the display of the keyword list may be the keyword display of the current 
application. 

[0071] 

According to this embodiment, since the currently effective keyword or all the keywords 
are displayed in a list type, a user may remember the keyword for calling the keyword list 
without remembering the keywords. 

[0072] 

Also, since the keyword list with a hierarchical structure is displayed, the recognition of 
the keyword for an application is easy. Also, the keywords are easily related between the 
applications. 

[0073] 

(Fifth embodiment) 

This embodiment, similar to the above-mentioned embodiments, is the case where a 
specific keyword is given to the keyword control conmiand conversion part 5, and the currently 
effective keyword group is displayed and controlled as a list group. 

[0074] 

For example, when a user speaks the phrase related to the "keyword list" through the 
microphone 1, the currently effective keyword groups are read out of the word dictionary and 
displayed on the screen 9A. At that time, each corresponding abbreviation (number or symbol) is 
simultaneously displayed in the keyword groups. 

[0075] 

Then, from the keyword groups being displayed, similarly to the above-mentioned 
embodiments, an operation is instructed by a speech input method of the keyword or a speech 
input of the abbreviation (number or symbol) being added to the list display of the keyword 
group. 

[0076] 

Figure 7 shows an operation example of the case where "Fukuoka" monitoring situation 
is determined out using a certain monitoring control system software. 
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[0077] 

First, when a user speaks "keyword list," the keyword control command conversion part 
5 reads the currently effective keyword groups out of the word dictionary 4 and displays the 
control conmaand and the keyword groups as a menu screen Al using the system software 8. 

[0078] 

Next, from the menu screen Al being displayed, the user speaks "file" to know the 
keyword of the file. Thus, the effective keyword groups for the file are read out of the word 
dictionary 4 and displayed as a file screen A2. Next, though it is possible to select "execution" 
from the file screen A2 by speaking "execution," in the figure, the keyword group display of the 
execution screen A3 is obtained by speaking "1" as an abbreviation. Similarly, a monitoring 
control screen A4 is obtained from the execution screen A3 by speaking "2" as an abbreviation 
of the monitoring control, and "Fukuoka" monitoring situation can be obtained by speaking "4" 
as an abbreviation for designating "Fukuoka" of the screen. 

[0079] 

Here, the keyword "macro" being displayed on each screen A1-A4 gives a function of 
macro-processing speaking words and a speaking sequence in a speech and can be implemented 
by speaking fewer words in a high-frequency operation. 

[0080] 

Figure 8 shows the case where a monitoring situation is obtained using the macro, and a 
macro screen A5 is obtained by a speech input of "1 1 " as an abbreviation of the macro of the 
menu screen Al. On the macro screen A5, "Fukuoka" as a geographical name and "monitoring" 
as a division of the monitoring control are displayed at the same time, and a monitoring situation 
display of "Fukuoka" is obtained by a speech [input] of "3" as an abbreviation. 

[0081] 

As mentioned above, according to this embodiment, without preparing keyword lists and 
without the user remembering keywords, a required keyword can be easily detected from the 
screen display by remembering one keyword for calling a keyword list. 

[0082] 

Also, according to this embodiment, the abbreviations of the keywords are received in 
addition to the keywords themselves, so that the number of words spoken by a user can be 



reduced, the complexity can be minimized, and the speech recognition rate of the system can be 
improved. 



[0083] 

Also, according to this embodiment, the spoken words and a speaking sequence in a 
speech are macro-processed, so that the operation can be simplified and sped up and an intended 
operation instruction of the user can be realized. 

[0084] 

(Sixth embodiment) 

Figure 9 shows another embodiment of the present invention and shows table data of a 
keyword-control conmiand table. 

[0085] 

In the above-mentioned embodiments up to now, since the window switching and the 
operation instruction in response to speaking a specific keyword are carried out, it is necessary 
for a user to remember the keyword. For this reason, when the memory of the user is indistinct 
and a correct keyword cannot be accurately remembered, the window switching and the 
operation instruction are impossible. 

[0086] 

In order to solve this problem, preparing keyword lists is considered, however in 
dynanndcally switching applications in the GUI environment, preparing keyword lists for each 
application is complicated and impractical. Also, each time the application is changed, the list 
has to be rewritten. 

[0087] 

Accordingly, in this embodiment, in order to obtain an intended control command of a 
user who has an indistinct memory without preparing keyword lists, the keyword-control 
command table 6 as shown in the figure is prepared. 

[0088] 

In the example of Figure 9, the case where several (three in the figure) keywords "aku," 
"ake," and "open" are prepared for the control command description to open file open is shown. 
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[0089] 

Therefore, when a user is opening a file using speech, if "ake" or "open" are spoken 
instead of a correct keyword "aku," it is converted into a correct control command by the 
conversion part 5 referring to the keyword control command table 6, so that the intended control 
is realized. Similarly, windows are also switched by preparing several keywords. 

[0090] 

According to this embodiment, it is not necessary for a user to remember a correct 
keyword, and without preparing keyword lists, an operation instruction can be obtained with a 
prescribed keyword by speaking related words that can be associated with the operation. 

[0091] 

Also, editing such as the addition or change of several keywords to the table 6 can be 
implemented by the input from a keyboard, however the editing may also be realized through 
speech. 

[0092] 

In the editing through speech, for example, said table can be set to an editable state by 
giving "editing of the table 6" as a control command to the system software 8 through speech, a 
keyword (for example, a speech of "registration") of the keyword editing is spoken, and the part 
having said keyword is retrieved from the table 6 by speaking a correct keyword. Then, the 
keyword of another name is registered in the table by speaking the keyword of said another 
name. 

[0093] 

(Seventh embodiment) 

In the embodiments up to now, it is necessary to accurately remember at least one 
keyword, however since the memory of a user is indistinct, a correct keyword is forgotten, so 
that only a portion of the keyword is sometimes known. 

[0094] 

Accordingly, in this embodiment, a system for obtaining an intended keyword from the 
halfway known part of the keyword is provided. 



[0095] 

In this embodiment, a user inputs a partial keyword through speech, and the suffix of the 
known part in the speech input is extended and spoken, so that a list of correct keyword 
candidates obtained by compensating the part after the prolonged sound is displayed. 

[0096] 

For example, in the case a keyword for displaying the contents of a file is "display," if 
"hyo" is known in the keyword "display (hyoji)" registered in the table 6, the suffix is extended 
and spoken like "hyo-." 

[0097] 

After receiving the keyword of which the suffix is a prolonged sound, the keyword 
control command conversion part 5 searches for the keyword in the table 6, gives a screen 
display command of a list of correct keyword candidates (for example, display, standard, 
evaluation, etc.) starting with the recognized keyword "hyo" to the system software 8, and 
obtains the screen display. 

[0098] 

From the screen display, the user once again speaks the correct keyword "display," so 
that the operation instruction of the correct keyword "display" can be obtained. 

[0099] 

According to this embodiment, even if the user forgets the suffix of a correct keyword, 
if the initial portion is remembered, the correct keyword is found out of the keyword list 
displayed by the system, so that the correct keyword can be input through speech. 

[0100] 

(Eighth embodiment) 

In the embodiments up to this point, in the speech input with a known correct keyword, in 
the case a continuous operation such as "enlargement" and "reduction" of the screen and 
"movement" in all directions as a keyword is instructed, the user repeatedly speaks the keyword 
(for example, "enlargement," "enlargement," and "enlargement") to obtain an expected screen 
state, and this is a complicated process. 



[0101] 

Accordingly, in this embodiment, a system for simplifying a keyword input of the same 
continuous operation instruction is provided. 

[0102] 

In this embodiment, in speaking a prolonged sound in which the suffix of a keyword is 
extended, the same continuous control command can be repeated in accordance with the length 
of the prolonged sound, so that the repeated speaking of the same keyword is not required. 

[0103] 

For example, in speaking the keyword "kakudai" for enlarging a screen, "kakuda-i" with 
a prolonged sound is spoken. For this speech, the speech recognition part 3 recognizes an 
enlargement operation from the part of the speech "kakuda," referring to the word dictionary 4, 
gives "kakudai" as a keyword and a code meaning its continuity to the keyword control 
command conversion part 5, and repeats the generation of the control command of the screen 
enlargement by said conversion part 5. 

[0104] 

Then, when "i" being the suffix of the keyword "kakudai" is recognized, the speech 
recognition part 3 gives a code meaning to stop of the repetition control to the conversion part 3, 
so that the conversion part 5 stops the generation of the control conraiand of "kakudai." Thereby, 
the system software 8 stops the enlargement display control of the screen. 

[0105] 

The reduction of the screen and the movement in all directions are similarly carried out. 
Furthermore, this process can also be utilized in menu selection, etc., using a pull down menu. In 
other words, when an item in the pull down menu is selected, each keyword "ue" and "shita" of 
the vertical movement of a cursor are generated with a prolonged sound, so that the cursor is 
moved in the vertical direction as long as the prolonged sound continues. When the speech is 
finished, the cursor movement is stopped, and the item at the stop position can be selected. 

[0106] 

According to this embodiment, in a continuous operation instruction by the same 
keyword, the user speaks the keyword with a prolonged sound, so that a continuous control of 
screen enlargement, etc., is carried out as long as the prolonged sound continues and the speech 
is finished when a desired screen state is set. Thereby, the continuous control is stopped, and the 
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user can obtain an expected screen state. Thus, the user may speak the keyword once, and a 
continuous operation instruction is made easy. 

[0107] 

Also, in this embodiment, instead of the keyword with a prolonged sound, a keyword in 
which a prolonged sound is added to the suffix (for example, "kakuda-i") is spoken, and the 
operation instruction of said keyword is repeated as long as the prolonged sound continues, so 
that an equivalent operation effect is exerted. 

[0108] 

(Ninth embodiment) 

In the system constitution of Figures 1, 4, and 5, generally, since 100% recognition rate 
of the speech recognition cannot be achieved, some erroneous operation of the system is 
expected. 

[0109] 

Accordingly, in this embodiment, a system for reliably preventing an erroneous 
operation, even if an error occurs during the speech recognition, is provided. 

[0110] 

Figure 10 shows a speech recognition interface of this embodiment. A speech operation 
button 1 1 is a software button, and an enabling signal for speech input is given to a speech input 
interface 12 by its ON operation. With the installation of the button 11, when the button 11 is 
turned off, the speech input is cut off, and the penetration of noise due to surrounding noise into 
the speech recognition part 3 is eliminated, so that an erroneous operation due to the noise is 
prevented. 

[0111] 

An input level check section 13 checks the level of the speech signal passed through the 
interface 12, and the speech signal with an input level lower than a normal level is cut off, so that 
an erroneous speaking due to the low-level speech recognition is prevented. 

[0112] 

Also, when the speech signal is cut off, the input level check section 13 transfers a signal 
indicating the cut-off to a response function part 14. 
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[0113] 

A recognition result reliability check section 15 checks the reliability of the recognition 
result of the speech recognition 3 and stops the transfer of the recognition result to the 
conversion part 5 when the reliability is low. Thus, operations caused by erroneous speech are 
prevented by checking the reliability of the speech recognition. 

[0114] 

Also, when the reliability is low, the check section 15 transfers a signal indicating an 
operation stop to the response function part 14. 

[0115] 

When the speech recognition abnormality signal from the check section 13 or 15 is 
received, the response function part 14 requests a user to repeat the speech. Also, when the 
abnormality signal is received even after the request to repeat the speech, the speech operation 
button 1 1 is forcibly turned off, and the input request is made by the user or other input 
interfaces (mouse, keyboard, etc.) 

[0116] 

Therefore, according to this embodiment, only when the user inputs the speech by the 
speech operation button 1 1 is speech recognition is implemented, and as a result of check of the 
input level check section 13, only when the actual input speech is a level suitable for recognition 
or higher, is the speech recognition implemented. The reliability of the speech recognition result 
is checked by the recognition result reliability check section 15, and only the speech accurately 
recognized is responded to. 

[0117] 

Also, for the abnormality generation of the speech input and recognition, the user is urged 
to re^input the speech or to input the speech by another interface, so that reliable speech input 
and recognition can be obtained. 

[0018] 

(Tenth embodiment) 

In simultaneously displaying several windows, a limited system resource can be 
optimally distributed by changing the frame rate of each window in accordance with the height 
of the degree of window (the degree of interest) of the user. 
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[0119] 

The degree of interest can be estimated from the display state of the window. As its rule, 
as shown in Figure 11(a), it can be said that the degree of interest is high in the window closer to 
an active window and the smaller the area of the window, the lower the degree of interest. The 
frame rate of the window is also be changed by the degree of interest. 

[0120] 

In this rule, the degree of interest is automatically determined by the display state of the 
window, and in order for a user to optionally change the degree of interest, an operation such as a 
change of an active window is required, and the operation is complicated. 

[0121] 

Accordingly, in this embodiment, a system that can display an optimum distribution by 
reliably and automatically estimating the degree of interest of a user is provided. 

[0122] 

In this embodiment, as shown in Figure 1 1(b), the window in which a pointing device 
such as mouse is positioned is recognized as a window with a high degree of interest of a user by 
the system, and the frame rate of the window is raised. At that time, the active window is not 
changed. 

[0123] 

Therefore, in this embodiment, with the change of the pointer position of the pointing 
device such as mouse, the degree of interest of a window is automatically changed, and the frame 
rate is also changed. Thus, without a change operation of an active window, the user can 
optionally raise the degree of interest of a specific window. For this reason, the operation for 
raising the frame rate of the window with a degree of interest of the user is simphfied, so that a 
more easily usable system can be constructed. 

[0124] 

Effect of the invention 

As mentioned above, according to the present invention, since windows can be switched 
through speech using the speech recognition interface, a conventional window switching 
operation using mouse, etc., is not required, and the windows are switched through speech. Thus, 
the operation efficiency is raised, and erroneous operations can be prevented. 
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[0125] 

Also, in the present invention, the window information of several applications is 
managed, and when each application is designated through speech, a window is switched to the 
newest active window of the application from the window information. The windows are 
switched in order of a new window of said application by the speech of the same application 
name. Thus, the window being often used is easily designated from the windows of the 
applications. 

[0126] 

Also, in the present invention, since an active window is discriminated from other 
windows and displayed by a speech input and a task hst in which an active application is 
discriminated is displayed, a user easily recognizes the active window and application. 

[0127] 

Also, in the present invention, using a task switching, the input into an application by a 
speech and the input into other applications by other input devices such as mouse are carried out, 
so that several windows can be operated [simultaneously]. 

[0128] 

Also, in the present invention, when a user speaks a specific keyword such as keyword 
lists, since the keyword registered in the word dictionary or the currently effective keyword list 
are displayed on a screen, the keyword required by the user can be easily detected from the 
screen display, so that all the effective keywords can be detected from the screen display, simply 
by remembering one keyword such as keyword lists. 

[0129] 

Also, in the present invention, since table data are constituted so that several keywords 
are made correspondent to one control conmiand in the table for converting keywords into 
control commands and the control conmiand is obtained from one keyword, even if a user cannot 
accurately remember the keyword, an intended control command of a user is obtained by a 
speaking a keyword related to it. Thus, an accurate memory of the keyword is not required, so 
that the usage method is improved. 

[0130] 

Also, in the present invention, a user extends the suffix of the known part of a keyword 
and speaks it, so that keyword candidates are displayed on a screen. Thus, the user can detect a 



25 



correct keyword from the screen display of the keyword candidates, and if part of the keyword is 
remembered, a correct keyword can be detected. 

[0131] 

Also, in the present invention, instead of repeatedly speaking the same continuous control 
command, one key word with a prolonged sound is spoken, so that the same control is repeated 
as long as the prolonged sound continues. Thus, an operation instruction by the same keyword is 
realized by one word in which the prolonged sound is added to said keyword, and the same 
continuous operation instruction is simplified. 

[0132] 

Also, in the present invention, only when a user carries out a speech input is the speech 
recognition implemented, and only when an actual input speech is a level suitable for the 
recognition or higher is the speech recognition implemented. The reliability of the speech 
recognition result is checked, and only the speech accurately recognized is responded to. Also, 
for the abnormality generation of the speech input and recognition, the user is urged to re-input 
the speech or to input the speech by another interface, so that reliable speech input and 
recognition can be obtained. 

[0133] 

Also, in the present invention, the window in which a pointing device such as mouse is 
positioned is recognized as a window with a high degree of interest by the system software, and 
the frame rate of the window is raised. Thus, without a change operation of an active window, 
the user can optionally raise the degree of interest of a specific window. Thereby, the operation 
for raising the frame rate of the window with a high degree of interest of the user is simplified, so 
that a more easily usable system can be constructed. 

Brief description of the figures 

Figure 1 is a block diagram showing an embodiment of the present invention. 

Figure 2 is a window image in another embodiment. 

Figure 3 is a task list window image in another embodiment. 

Figure 4 is a block diagram showing another embodiment. 

Figure 5 is a block diagram showing another embodiment. 

Figure 6 is a keyword list window image in another embodiment. 

Figure 7 shows an operation instruction sequence through speech in another embodiment. 
Figure 8 shows an operation instruction sequence through speech in another embodiment. 



Figure 9 shows a data constitution example of a keyword-control command table in 
another embodiment. 

Figure 10 shows a constitutional example of a speech recognition interface in another 
embodiment. 

Figure 11 is a window display example in accordance with the degree of interest in 
another embodiment. 

Explanation of reference symbols: 

1 Microphone 

2 Speech recognition interface 

3 Speech recognition part 

4 Word dictionary 

5 Keyword control command conversion part 

6 Keyword-control command conversion part 

7 Computer 

8 System software 

9 Display section 

10 Task switching part 

1 1 Speech operation button 

12 Speech input interface 

13 Input level check section 

14 Response function part 

15 Recognition result reliability check section 




Figure 1. A block diagram showing an embodiment 



27 



Key: A Window 

B Application 

C Comnnon dictionary 

D Recognition keyword "window" 

E Control command (active window conversion) 

1 Microphone 

3 Speech recognition part 

5 Keyword control command conversion part 

6 Keyword-control conrniand conversion part 

8 System SAV 

9 Display section 
9A Priority order 2 

Active window 
Priority order 1 
Priority order 3 
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Figure 2. Window image 



Key: 1 Application A 

2 Application B 

3 Application C 

4 Application being started 
Application A 
Application B 
Application C 
Application D 

5 Active window 




Figure 3. Task list window image 
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Key: 1 
2 
3 



Task list 
Application A 
Application 




Figure 4. A block diagram showing another embodiment 

Key: 3 Speech recognition part 

4 Word dictionary 

5 Keyword control command conversion part 

6 Keyword-control command conversion part 

8 System software 

9 Display section 

10 Task switching part 
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Figure 5. A block diagram showing another embodiment 



Key: A Keyword list 

B Recognition keyword 

"Keyword list" 

C Control command (keyword list data) 

D Acquisition of all keyword data 

E Display of keyword list 

1 Microphone 

3 Speech recognition part 

4 Word dictionary for a speech recognition 



5 Keyword control command conversion part 

6 Keyword-control command conversion part 

8 System SAV 

9 Display section 

0 
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Figure 6. Keyword list window image 



Key: 1 
2 
3 



Keyword list 
Common 
Application A 

Application B 
Application C 
Application D 



Common word list 
Application Al word list 
Application A2 word list 
Application B word list 
Application C word list 
Application D word list 
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Key: A Menu 



B 



C 



1 


File 


2 


Edit 


10 


Cancel 


11 


Macro 


File 




1 


Execute 


2 


Print 


10 


Cancel 


11 


Macro 


Execute 



1 **Program 

2 Monitoring control 



10 Cancel 

1 1 Macro 



Monitoring control 
1 Sapporo 



E 
F 
G 



Key: A 



B 



C 
D 



2 Tokyo 

3 Osaka 

4 Fukuoka 

10 Cancel 

1 1 Macro 
"File" 

Microphone 

Monitoring situation display 



Figure 8. Operation instruction sequence through speech 



Menu 
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File 


2 


Edit 


10 


Cancel 


11 


Macro 


Monitoring control 


1 


Tokyo, monitoring 


2 


Osaka, monitoring 


3 


Fukuoka, monitoring 


20 


Cancel 


21 


Macro registration 



Monitoring situation display 
Microphone 
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Figure 9. Table data constitution example 



Key: 1 Keyword 

2 Control command description 

3 Aku 

4 Ake 

5 Open 

6 Command description for opening a file 
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Figure 10. Constitutional example of a speech recognition interface system 



Key: A 


Speech 


B 


Other input interface instruction 


C 


Synthetic word 


3 


Speech recognition part 


4 


Word dictionary for voice recognition 


5 


Keyword control command conversion part 


6 


Table 


11 


Speech operation button 


12 


Speech input VF 


13 


Input level check 


14 


Response function 


15 


Recognition result reliability check 



32 



^ox (2) 




lb) 



© 



Figure 11. Decision example of the degree of interest 

Key: 1 The numerals in each window show the degree of interest in higher order. 

2 Mouse pointer 

3 Active window 
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tc J: s rr 'J ^- 3 yf^mx-n b . ■^'^xmamnx 
■hriM 7.\,zi.h i&<r)Ty 0lr-->3 y^coA^j t b . 
mL<7)^-i yY^inm^tthzbiti^x'^^j:oi,z 

[0 0 19] mi2#^l2iSS'fy^7x-X{i:. ^ 

^ts^^^i^«o#i§®»(c{ir7- 'J ^-i- 3 ymmm 

fct^lc. fn&*iS^»(c^^ixTV>S^-7-K'J 
Y ij X h ^ Hffi«^-ri.$!lffii3-? y H Jrlinei'Xf A y 
[0020] J: 0 . fijffl«*^^-7- K-g 



WEST 
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[ 0 0 2 1 ] ^/i. friaw^igfi^ y^'7x-x{i, fr 

[0022] zcommzjL 0 . mm^tf^^-v- stje 

[00 2 3] s^i, iiiriew^^-^i^:J'7x-;^{±. =^f 
[0024] ^commzx 0 . m^m-'7~ n-o^ 

-^.T t ^SgP^OiSM&gtf LTSI^-ri. w k J: 1) . 
[00 2 5] ^/i, |tJiew^i2l§S^>^7x-;^{i. ^ 

[0026] ^(ommzx *) . mmmtmrn^^-ry 

3 ffHz 1 0(7)^- 7- H56|Sf«tf J: oliZtt. 
[00 27] tfz. •Btrie^^lM^i^^'7x-x(±, jfij 

•y^^t. ^^S^m«Oli^Sr^x -y ^ LXlEmiC 40 

[00 28] z<7)mmzj:*). y -i X(r)mx'^i^o\^T^ 
R<^=^pizj:tmimm±L. tf::mmm^m 

[00 29] W^Ji, frlEi^Xf AV^h-^x 

zti^mtti, 50 
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[0 0 3 0] K^mmzx*). r^^^^y^ ^yY-^^ 
^^\zm.x%^i.okz-fh. 

[003 1] 

^^iM^ >'^'7x-XgP(7)yo./^'l2IT'S>l.. 
o7=ryi(4, *iJffl#*s3ytjL-:}'i';?.TAtcS{^jg 

[00321 W^igiJ^ y^7x-XgP2{4. 

313 k , ^?&l2iSfflmiSPS4 k , =>(— 7- FSiJfflin^ 
^H^S55k. df_y-KJt^Jt^3vyb'T-ryl^6 

k&fl-r-s. 

[0 0 3 3] #^l2iSgB3«4. -7^^'07;j-y l*^^cO 

^^<i-f ^#^l2iSW#ii^§4 kss^t, i2ilii*«-gc 
Uc^-7-K^te*kUTai:/3-r-l.. ^J;ltf, fM^ 

-7-h-kLT#l). 

[0034] ^P6|2^ffl#isg«4 {4, E^cT) J: 3 1:, 

^^ii*iS^^kLTV^|,, 

[0 0 3 5] df-7-HS0ffll3^yH^a5{4. 
igflESP 3*>4>0^-7-K$rdr-7- h'*f*lffll 3 -? y K 
r-r;P6Sr#ffit. iSa-r'5.SiJffll3-7yKi&#-S,, 

[0 0 3 6] f— 7';U6J4, #^-7-Ktl^^UcW 

[00 3 7] 3yh'A-^2|s:*7<0>'XTAV7h^x 
r8<4, MS-Wi ndow^X-Wi ndow sy 
stem^(7)GU I i^^Srj^V 7 h-^XTlS^tw? 

(::, df- 7-K$iJffllavyH^^g85*>4>c7)$iJfflia-7y 

[0 0 3 8] ^aHQti. i^XTAV7h'^xr8A>/^ 
«a^JWCJEtJt/97 -f -y^-f-f X7-U>f ^162:)^ 
^Bffi9A(C{4|il-Iiffi±t1Sl:<^r7-'J^-i^ 
3 y ( "^-Y y ) «^2rff -5 ^^*<7)^^l 

[003 9] <ici-c\ i^^mmxM.. vXr^yV 

^s.7d,\zi.hmvm^mz\t. ^^BH9Atc^s^ 

'>SrSt>S5yifil[<?)i«v^t,«r)k LTfc< . 

[0040] r^r-f 7'•>■^y^''>^ois^c^^Bt 

*'>'<yH':7?:2#@<?)ffi5yii(2kL, -?-C0i5<O'>-Y V 



WEST 
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[0 04 1 ] -eLT. •>X7-M.yy}-'ya:78it. hh 
ru^r-i^gy (^^yY^) nmz^Wfh^-iyY 

r>tn^^yY^mMm^2mU(7)\>(r)t:79y- 

^f^^y Y^iizth^^ y Y^mmm^. 

[0042] :i<r)^^yY'^'9]mmzX^'^^yY^ 

y Y'^sm^mmrmzi-t. 
[0043] uc^^x. :^mtmmizxin^. mt 
■ti>77uy'-iy3yimTi'f-^y^j:m.<r)t^. m 

m^ii'SPlzXr.x^-^ yY^^mcr>^-'7-Y^^ 

tizb^zxf). "^^m^sizxi^pumt^-v 

- HSiJftI 3 V > H 5 J: I. 3 -7 > K^co^ 
m^tL. ZtHzX'0->:^7-^VyY'^:i:.78izXm 

yY'^mm(^^-'7-Yii<^p^tiimz&miiicr>m 
\,\'y^yY'y^zmmt^ti. m-tt^^yY^t:T^ 

[0 044] ^IMZX'O. mm^li. «f^Lit^^'>-fy 

^yy-^ y^^ffU xin^-thmts:< . I^^co^--? 
-Y^^'^^h(r}?).xm^. Ztilzmi-fXT^T^f^j: 

mco^-! y Y^^zmtmr^m^^^^px-no ztt^ 
T'#, mmm^mibizt-ipx'^^htmz. mwtfph 
m<'zki}<x'^i. 

[ 0 0 4 5 ] >5:fc . T-i'coXMi^-^^- Ymi^h'ft 

oIj^. Xiimm^y'!^y3:-m2i,zi.hf-'^ 
[ 0 0 4 6 ] 1 3t . ^-iyY '>o«^t Ji. m^<n^- 

y-Y (sifflinvyH) imm^%\>zi&9m.m-m 
mii>^TM,vy h'^xr(ii<7)y7 h'^xTc?)^-cii 

'S.^WX^l. 

[ 0 0 4 7 ] f5i)x tf . '^'f y Y'^mmtmn<^^~v~ 

m x'T^T-^y'^^ yY^^mmizmi. ^^y 
Y^'cmtw±n^-'y- Y ^^»mnz tt^^z^^-^y 

i,ztfz « >- F ^^micomifb y Y^^^nm 
i^^px^L. '>:^Tmxm^^ yY^m^^:^ 
->^-<yY^i7i?T<y^^-^yY-^fti>:H^X'{,!^ 

[0 04 8] <y^'T'fXrU>ftC«^$ 
ixl^^ < y Y^{zmM!&mti^tz r Lii 0 J Sr# 
tt. 1^7) rtfcOj ^=^PX'm.-ti>Zb\,zi,^m.<^ 
^ <yY^i:ri?r<fiz-rh^iyY^'^m)j^tt 

hZtt^X'^h, 
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[0049] mt\i. r tts 0 J cois^^i^ii, fci. 

tl). ^LX. TfT <f\,Z'th'^ t yY^<Ti^^\i. 
r U*3 0 1 J ^rt'S:f6^-ri.v: 1 1 J: "9 ^iS-^ y H-^ 

[0050] Z<D^. Wi^-mW^ixh rt^feOj 

[00 5 1 ] J-UicT) rtfcOj l,zXh^<yY'^m^ 

^c^SHffl '5<!0'>^'yH'>S:lIIl cOfg^fT ^' r ■< 7(c 
Xth. 

[0052] tt^^ i^XTJ^VyY^3.7S><Z^^yY 

20 '^'fasR^ istt. Of agptc^^ifcT)'^ ^ y h '^«^}-^ 
br^'f'sr-^-iyY'^mmfr^T^r^^yY'^ 

[0053] mt\t. SSfCOrr 'J ir-i. 3 y A-D*i 

#rry^-i^3yio+Tt.^»>-f yH'^A 

1, A2*i^$iXTV^I.^fc®T\ "^P^Zii^ ^TT') 

Bj t^^-s.t. fagi5>&irr'jir_^3yB(7)ftff 

<^7i>T^f'^-iyY'^i:^-i-LX. mi.\frr')'r 
30 -i^gyBlSrT^'T-fT'fc-ri.. 

[0 0 54] $<i>{C{i. ^^iCiO rrr'JBj &jB?»t 

T^-rst. 'd:.<r)7y'^)h2'k7i'f^y'.zti. 
[0055] (m2<r)mmm) mi<r>mmmz^\^ 

|fpst:J;'5'>-<yh*'><50«]m;c.S'm\ SISrru 
ir-i^3y<0«f^S:fi=5*<. ^^con?^ yK'>*m'5 
firo*iii:'c07*7-'J^-i'3y*<Ti'f-^y 

x-hhii^mm^zmoztifi^th, ttz. ^^^yY 

40 [ 0 0 5 6 ] -eCl-C', *IUtig®T{i, 13 2 (C^tJ: o 

t^. itacorru^r-xgy^isas+cc, »i;i«f r^'x 
ffli 3 V y H *> f> i^xf A y 7 b XT 8 (i?l?ESij*<?) 
0 (c^'x^' 'J X h i: Lxmrntm^t-ri , 

[0057] Z<rM. m^T^T <f^J:7r^J*r-i^ 3 

y (mmrr^j^-yayh) {i. ri^Tiyxhh 
^Srtf3. ^;t. #'>-^yH'>rtlc§^.lc?-':7-<yK 

50 ^iph'>^i^. miiirrV "r-'y 3 y D t'J±^ <?)^ 
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let I.. 

[0058] intf , fijffl#{i3147?r . 

[0059] ( m 3 cr>wmm.) mA\i^wmmff)% 

[00 60] ^'X:7^3)^^g|51 0<i, i'XrAy^h'^X 

[ooeni^i^ji. io<?)'>^yh''>(i5ijti?rT 
[0062] z<7)tt. ^:^^m3i 0{i. rru:)- 

-i^ayBi'^^Xm^bb. TTV^-l^ayAi 20 

[0063] zcr>A:h¥^-<^ xcom^Mli. fM^fc 
vAt rru ir-v- g vBjifficTjrru 3 v 

[0064] ±i2«oA^iTVNM x<a)«i:im*>'?><oa'js 

7x-X2fcJ:|.:J'X:7tJ^g|51 0^<7)ailf3vyHT' 30 

[0065] :^mmBmizxini. mLco^^y}^"^^ 
mmmti-i:iti^x-^h. 
[0066] imAcnmmm) m5ii:^^m<mc^m 
mmrpt. :^mmmmx'\i. ^-y-nsijwnyv . 
y^m^5m&(r>^'-'7-\^f}<^z.kixtii:^i,z. # 
mm4izm-^iix\>^i,^-'7- h u x h sr-sg^t 
Lxmyf^mx'-^ s J: a c Lf^^tcfci. . 

[ 0 0 6 7 ] fi^Jttf, laSOlf^tCfcV^r. V>f ^D7 
:r y 1 ^ii LT . fW^A^ r df-y- H-M j 40 

^^t/its. "^pv^msx'ii^m^mmm^ 

-7- H$IJ1W3 HSgjaSJ 5 K4i S , Hildas 5 

y7h'>XT8l3-^;t. £^Xf-Ay7h>>x78(lJ:|> 
^^^iJiWtc J: 0 ^-7- H U X h 2rHS 9 A±K:«^$ 

[00 68] I16<i:=st— V-H'J;^hcOBffl^^|^^ 
:^rr'J^-v'3y<?)=Jf— 7-H^i:ft)l#g'J 50 
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[00 69] ^Tt, ^7ro->-—>aymzmi'i<7)TT 

>J^--^3ymt^m. MHiTrOir—>3yA 

[0070] ^fc. ^-7- H U ;^ hc7)^$rJl^BtS!; 

[0071 ] ^m^m^zXtiU. 3S4^=5rdf-7- 

H U X F Wffi L<7);tJ6c0df- 7- H $r:l t T < ^ 
[ 0 0 7 2 ] Mffi)^Odf-7- H 'J ;^ 

tc5:l>/ii6, rr'j^-£^3ym{i<o=3f-7-HiOi2;ii 
tm^^ztch, ttc. r-r')'r-i^3y^<r>^~v-Y 

[0073] (mscoHSSJ^HI) *lim®f4, MecT) 
IIStei^«ltl»l«li, ^-7-H»J1JP3yvh'S^«|55(c 
m%(n^-v-Y■^^^■i.t:>1^.fz)L%\iz. iSftW^Sh^-p 

[00 74] ^UK, V^^'07>r>'lS:jlLT, 

•?-ix«-iiffi9A±{c^$-^|.. >iiOi:#, df—y 

[0075] C:c?)ftcoaf^|^J4, ^q^$iil.^-7- 
izX&im. X{idf-7-HI¥<?)-^^tc#Jnt'i.BS 
[00 7 6] 07(4, *)SiaS$lJfflIV7hn7xrS-fflV% 

[ 0 0 7 7 ] i-f , fl]ffl«<4, rdf_y_ 
PUzk^ {c=^f-7- y HgE«iSP 5 *«3itt*- 

$!;=3:^-7-HSf^mgS«4*>^>S!^2^, Cco$iJffll 
n vy K ^-7- N'mc J: -3T i/Xr AV 7 h 7xr 
StCi 0;<-i-BMA 1 i: LT^-ra, 

[00 781 <}^ti, ^^$ix§;<-jL-HffiAl*»^>, 
fiJffl^Ji, 7r-<;K7)df-7-HS:»S/Stf>(c r7T-< 
^Pj ^^-ri.. vlfLCiO, 7r-<McoV^Tt5&^ 
=Sf-7-HP*<#g?S«4*><i,IS^ai$ix, 7T'f;Hi 
fflA2i:Lr^$^l.l). JJCtC, 7T>f;HifflA2*> 
4." mf" imiR-t^lz\i. ruffj (O^^f^tg 
X:hh1f. mcQXt^ay^^t LXff) r 1 J ^pi,zj:h 
|l1tBMA3W=^~7-HPa^$:^#S. |5l«tc, Htf 



1 1 

r4j W#|SfcJ:0 rtiisgj commmmzti^X' 
[00 79] v::c:t\ #ilffiAi~A4tc«s$itl.^ 

[0 0 80] I18«4, v^'a^ffi^^ll««3i«-f#I.J© 
■&$:^L, ^-a-afflA 1 iOV^'n<7)B&-f r 1 1 J c7) 

[GOBI] lOiiOvl i: J: 0 . iixjf . 

-7- K '/x b ^ fflS-rs ^ t=3r< . * /;fijffl**<=3f- 

ait:'^*^^ 1 imxi3<Z bX-'^Wj: 

[00 82] ifc, *limW:J:ixtf. ='f-V-K-e 

[00 8 3] ^7t, *llifeJ^®tJ:ix{f, ^I&T-C0|6?S 

I.. 

[0084] {m6(/)miimm)m9ii.:^wmim 
[0085] w^tx'<^mmmmx'ii. i^^<r>^-'7- 

^j:^tzib. Zcr)^~V~\^?:mmmimtXi3<<mi)^ 

[00 86] ciconffltcji, 

[00 87] -e^T'. *»iJg®T-j4. =^~'7-h-yx 
[00 88] ia9<7)8?llt1i. 7-7^)V'^-r><r)t:.}^<r> 

mm-^ynm^zMLx. (iaji^t-{43o) 
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[0 089] li::¥'>x. mm^ti^y r ^ }Vi^~ry^ 

wt-rsKW5r$ixs. mmz^ ^^yY^mki^m 

[0090] *||SfiJ^}||(Cj:ixff , fiJffl#*<iEH,^=Jf- 

i^-Th z b xmmm-^~ )'izximm^m 

lZb¥X'^l. 

[ 0 0 9 1 ] ^tJ. f- 7';l'6'\c0lSI?tt7)^-7-Hc0 

[009 2] v:£7)#^(;J:Sfflm{4. ^R«f. '>XfJ^ 
V7h^:^T8^!^ma'7yYblX r-f- /y^6cO 

flItcL, »:t^-7>-Kfflmc^dr-7-H (g^Jxtf. 
20 rgiitj jEU^r^df-7'- Hcoil^C 

J: 0 r-T';!. 6 j6>f>iS^- 7- H ^^^-pfl^Srl^ L , 
»:v^Tm<7)='f-7- \^<r)^izX 0^iJ«<7)^-7- 

[0093] imicomtrnm) ztiix'<7)mm^mx' 

li. 'y^£< b t loc7)^-7-HS:iEJiti:;cTfc<'£' 

[0 0 94] -e^t', ^IISfiJ^ffiT'fi. ^-V-Y<r>^ 
30 4'4T'^*>^Tt>l.gS^J-*-'^.gWt-ri.^-7-H$-tf 

[0095] ^m^mx'i,t. mm^im^tx-^f^-^ 

x\^m'rfnmnAW.i Lx^th zbi-z 

nrnxY^m^j^-thm^b-fh, 
[0096] mt\i. yr^)V<r>p^mi^sthfzii^(r> 
=it— 7-H^ r^^j tUc^^. ■f-7';l/6tcSI|i$ 
nrvM.^-7-K iihi 0 t] J {CWLT. 
40 [tAi 3 ] fC:«>A>-?-CV>ix{r tAi -3-" tUSSrji 

[0097] CliO^Jl*5;ft^<?3df-7- H $:gttro-?!t 
df-7-K*iJffll3VyH^gE5t4. ■r-7';U6|*Ii0df 

45iELl^^-7-H11fflOUXh (glRJf. ^> g 

[00 98] z<mmmd)>t^. fiiffl#*qELv^=jf-7 

50 7-F r^^j tiS^^B^Srtt*. 



1 3 

[0099] ^mmmizxm. fijffl^A*iE«i^r^- 
[0100] (s^sc^nj©^®) j:*t.s x'<r>mtmm' 

[0101] -e;T\ *iutjg®-c{i. j^Litisitji 
I.. 

[0102] ^^SSJgfBTti, h-<7)ilM5-®{? 
[ 0 1 0 3 ] «;ctfs iifficot!yv:Srff3=^— rjfe 

^t. mmm5i,zj:',xmmmzmm^'7yYff)^ 

[0 104] -eUT. ^?&gHigg|53*«^-V-h- rj£ 

r A y 7 b »:7XT 8 i}m'^(r>mk^s%m^w±-r s . 

[0105] iiffl40iffi/jN^±T£*'^<?)i^SSKov%-ct 

=^:r-mmt'izhnmthzti}<x'^t. t^shh. 

£0±T^i)co^-*i^^iifiO^-v-H" -^i" , " Lit" 
[0106] i^WemhZi.tiM. fiJffl«{i. R 1:=^- 

#4. ^mcj:'). wmi^-^-Y'7M^m.^\ 
m^mm.fim-^^^^w,\,zts:h . 

[0 1 07] :5r*J, HJiJ^ltlciiO-C, 
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1 4 

-7- H Cf^ix T , HSfc^S^S- #ilD U^C^ -7 - H 
0 7- HcO^f^JiS^S:^ O jgtffiiSC LT PI^ 

[0 108] (SS9«0||{SJ^,^) 01^4 . SOvX 

[ 0 1 0 9 ] -e^r, *iimiiT'{i. #^t2sst:is o 

[ 0 1 1 0 ] 0 1 oji. *ll]S®jeB(50if^i2^^ v9 y 

A:»]'f >'^'7x-;^i 2t4;j.l.. ^Lso^^-yi 1$-^ 
\th^t^zji^.if^i'y\ i<?):t7ii$Wi#^A^i$5i 
Dft, jgH<^S#^tJ:Sy'fX*<#^l2ll|g|53WfA 

'rh<r>i^A Lx/^xt<zi:immm±th, 

[Oil 1 1 A:']U^/l'^x-y^'SSl 3li, 'fy:?'7x 
20 -xi 2S:aU;'•^#l^^t#(7)^A;;^5.:^J,.^7L. A^i 
K;U3!«i^J: Offiv^^^fl^SrjgBFr-rs i i: tc J; 0 , 

[0 112] t^::. A^J^'<;^^x•/^'gPl 3{i, 
fi^^)gBfL/::t#t, iJ?g^fiEa5l4fciil8rt?t^t 
cofi-tSriS-t. 

[0 113] si^mftmsf-x -yiJ-aBi 5{i, wms 

USPS t J: SSilifSftiOfilSJg^rf-x v :7 L . fiffiS*^ 

WciO, ^W2PI^-5-<7)<i!ffi«f-x>y^'fcJ:'3mr>!t 
30 ^^fcJ:|.«f^$-K±tl.. , 

[0 1 14] i^. ^x-y^'SPl 5{i. «iffi«*<ffiV^fc 

[0 1 is-immmmiMi. ■fx-y^'asisxtii 

pizi,m<^^i:^nfzt^iz^pmi^^'^yi i & 

40 [0116] Ltzi)^'>x . ^mmm^zxtiM. 
^lii^yi 1 tcj: ►)fiJffl**«^^A:ti-ri. t ^o^^^ 
lgiS$:llffS-t. A;'jW'^Wf-x-y:5'ai51 3KJ:0lli^ 

<r)K-h'^p-mmzm'^ts:\^^>v\:mzht t % m§ 

0#^i2il^*«OfiffiSSrf-x y ^' LXimm^Ltz 

"U^^^Mzmx-^ hi.0 \.z-th . 
[0 11 7 ] i^c. '^pxDmtm<^m'^m.\z\i. 
mmmzMxiMii^Lit'o . m<n^y^y3.-x\.zi.h 

50 hlfiX'th. 



1 5 

[0 118] (miQcommmm)^m<7)^^>\^'y^ 

[0 119] c:<7)Mi»ja<0ft$<i. ^'tyY'ycr)^^^ 

1 ic?) (a) 7^T-^7''^^>'H'>{C)S 
[0120] icOfV-lVX'lii. '^'<> V^ff)^^[Z 

[ 0 1 2 1 ] immmmx-M. fw^wsflcje 
co«^v ^ ^^i.zt-'ommzmssi Lxmmt<r>m^ 

[0122] ^tmmx'^i. m ,1 (?) ( b ) t^-rj: 

[0 12 3] Lfv:*>'ot. *5^m^-C*fi. V';7;^l?co 
[0 124] 

[fgB^i^SJS] WicOtJjO. *l60S{cj:iitf. 

m^y9y:L-xmmLs ^pizj:&^^y)'^m 

z.in^J^olzlfzfziib. '7^;:^^i>zJ:i,m^<r>^^y 

\''ymmmT^^izi, =^nzx^^^y\''ymi 
iz^j'^xmm'^-^i^itmz. WMi^m±tiz 

klfiX'th, 

[0 1 2 5] i/::. ^%mt. mjnrr^i'r-uBy 
(Ti^^yY-^m.^'mi,. w^tio^-rry^-v- 
3 y^^m.fzh%\,z^A y Y 'j'mt-hry'^) 'r-'^ 
sy<r)m\<r)T^^'{-/'^-iyY'^\iz'cmt^ Rtrr 
•J ^- 3 y^cn^^^^zi "9 mj7^) ^-i^B y<nm 

[0 1 26] i/c, =^PX-))iZl^. T^T 
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T'i-rtsi^AyY ^m/7r oy—^^y^ tmt i. o 
imiz-rimm^. 

[0 127] tti. *^BJ{±. ^'J^^J'^mt J: 0 , 

10 [ 0 1 2 8 ] . *^B^«i, fijffl**^=>f- V- 

H-Ml^co 1 oc^^-y- Hi&^tT*3< c7);%iT-^'5r 
^-"7- Kco^T S:Iiffl^*>'c.«l-?. c: i tt^X% h . 

[0 1 29] ^7t. *%BB{4. ^~v-Y^%\m-^y 
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